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(54) DEVICE AND METHOD FOR IMAGE PROCESSING 

(57) Games are processed in a more realistic and 
immediate manner during Image processing for soccer 
games and the like. Specifically, the movements of char- 
acters more accurately simulate those of actual oppo- 
nents, resulting in greater game realism. 

The invention is an image processing device for Si- 
imaging and displaying the behavior of characters mod- 
eled on opponents in virtual three-dimensional space. It 
is determined (821 to 824) whether or not there exists a 
certain situation in which the relation to the game con- 
tents (In the centering area, for example) or the posi- 
tional relation (such as distance) between characters 
and a target (such as opponent characters or the t)all) 
having a relation through the game to said characters 
matches certain conditions, and the eyes of the charac- 
ters are directed to the target (S25. 826, 828, etc.) se- 
when it is determined that the certain situation exists. 

The invention is especially suitable for soccer games. S7 — 
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Description 

TECHNICAL FIELD 

[0001] The present invention relates to an image s 
processing technique suitable for use in image process- 
ing devices such as TV games in which characters 
(objects, in the broader sense) are situated in virtual 
space to play a soccer game or the like, and more par- 
ticularly to an image processing technique for making io 
games seem more realistic and more immediate by exe- 
cuting various processes such as control of a charac- 
ter's eye direction, control of a character's behavior, and 
fog processing to adjust the colors on the screen. The 
present invention also relates to an image processing is 
technique which provides images that are easier for 
players to see by suitably controlling the angle of the vir- 
tual camera relaying the developing situation in a game 
or the orientation of objects situated in the game field. 

20 

BACKGROUND ART 

[0002] Progress in recent computer technology has 
led to the widespread popularization of image process- 
ing techniques for TV games, simulation devices, and 2S 
the like. The sophistication of image processing tech- 
niques which more realistically portray display contents 
and display screens is extremely important in enhanc- 
ing commercial value. 

[0003] The components of TV games, for example, 3o 
comprise peripherals, including a display monitor and 
operating instruments such as pads and joysticks, as 
well as processors with a GPU that executes image 
processing, audio processing, data transmission with 
the peripherals, and so forth, allowing interactive games ss 
to be played with such operating instruments. 
[0004] Game devices allowing soccer games to be 
played are one of the fields of such TV game machines. 
In such soccer games, a soccer stadium with a field and 
spectator seats (stands) is commonly constructed in 4o 
three-dimensional virtual space, and the characters 
(referred to as display objects or objects) of two teams 
play a virtual soccer game on the field. Specifically 
motion is computed according to operating data from 
players, the ball is processed, collisions (hits) are proc- 4s 
essed. robots are processed, the field is processed, and 
the like, in sequence, and game development reflecting 
the manipulation by players is displayed on screen. 
[0005] Because the behavior of the spectators in the 
stands is also an important element contributing to the sc 
game environment at this time, the behavior of the spec- 
tators is also often processed. Examples of methods for 
controlling the behavior of spectators include: 1) meth- 
ods in which a great deal of image data of moving spec- 
tators is prepared in advance for each frame, in the si 
same manner as with animation (moving images), and 
images are mapped with texture according to the com- 
petitive scenario and are displayed in moving images; 



and 2) methods in which polygons showing spectators 
are prepared, and the polygons are moved according to 
the competitive scenario. 

[0006] The problem of whether or not the display 
screen coloration matches the actual brightness (such 
as sunlight) over time throughout the day is another 
important element in enhancing the game environment 
or immediacy This is a particularly important feature of 
soccer games since they are often played out-of-doors, 
and there are subtle changes in the physical environ- 
ment related to brightness depending on the time zones 
during the day in which the soccer game is played. In 
other words, the brightness changes depending on 
which time zone - morning, afternoon, or evening - in 
which the game is being played and where in those 
times zones the game is being played. A method for 
adjusting the luminance of the color screen according to 
time zone has been known in the past. 
[0007] However, the aforementioned game machine 
suffers from the following drawbacks in terms of game 
immediacy and realism. 

[0008] First, using soccer games as an example, 
when characters play against each other while dribbling 
the ball in conventional game machines, the characters 
can dribble only while facing in the direction in which 
they are running. However, when shooting or passing to 
a team mate while dribbling in actual soccer games, the 
athlete that is dribbling looks (looks around) in the same 
direction in which he is running or in other directions in 
Older to plan the timing of kicks or to look for a kicking 
zone or team mates That is. it is difficult to realistically 
simulate the actual behavior of soccer players just by 
controlling running motions while dribbling, and the 
actions of the characters on the display screen are prim- 
itive and unnatural. The control of the direction in which 
a character is facing (that is, the eye direction) is the 
same for the player who is running while dribbling as 
well as tor other players who do not have the ball. Home 
team characters also naturally turn their faces (eye 
direction) depending on the actions of the characters of 
the opposing team, but no such control has been man- 
aged in the past. 

[0009] Second, the behavior of spectators is also an 
important element affecting the immediacy of a game. 
In the past, however, the varying movements of individ- 
ual spectators (more realistic behavior), simplicity of 
software design, reduction in computing load, decrease 
in memory capacity, and the like have not been satisfac- 
torily achieved simultaneously 

[0010] In cases where spectators are displayed with 
animated texture mapping as in the past, the low 
number of frames showing movement results in crude 
and discontinuous spectator movement. The number of 
frames is increased in an effort to avoid this. As a result, 
the image data that is handled increases, requiring 
greater memory capacity. Software design eUso 
becomes more complicated, and the computing load 
increases. When the load increases too much, charac- 
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ter (or object) control is hindered, resulting in the need 
to conserve spectator load. However, when spectator 
control is scaled back for such conservation, the screen 
that is displayed is not very exciting and lacks immedi- 
acy. 

[0011] On the other hand, when spectators are dis- 
played with polygons, the number of spectators which 
can be displayed with polygons is extremely limited 
when taking into account the burden involved In control- 
ling them. If the computing load for such control is disre- 
garded, it might be possible to display individual 
spectators with polygons and to individually control their 
movement, but that would actually be difficult for large 
numbers of spectators. Only specific (selected) main 
spectators should be displayed with polygons. In fact, 
spectators do have individually different movements, 
but they sometimes move the same in groups. The main 
movements of the specific spectators thus lack excite- 
ment and immediacy. 

[0012] Third, conventional devices are not able to 
cope with the requirements of game machines nowa- 
days in terms of controlling the physical environment 
relating to the actual brightness during the day. For 
example, the display screen should match the surround- 
ing environment of players who enjoy the soccer game 
while sitting in front of the game machine in given time 
zones throughout the morning, afternoon, or evening. 
However, when the luminance of the entire screen is 
merely adjusted, as in conventional devices, the screen 
becomes darker as night approaches, making it all the 
more difficult to play. 

[0013] Fourth, when games which unfbkj in virtual 
three-dimensional space are displayed on a screen, the 
ease of game playability varies depending on the direc- 
tion of the camera eye direction by which the virtual 
camera relaying the game sees the characters (or 
objects). The ease of game playability also varies 
depending on the position of the virtual camera. The 
three-dimensional display of objects should be empha- 
sized according to the game development area. 
[001 4] Fifth, when games In virtual three-dimensional 
space are displayed on a screen, the point of view and 
position of the virtual camera should be pulled back to 
display as much of the game field as possible on the 
screen to make it easier for players to play the game. 
When such processing is managed, the lines and mark- 
ers indicating the range of the sports game court are 
narrow as compared the entire virtual space, and they 
thus disappear because of the saeen resolution. 
Thicker lines have thus been prepared to prevent such 
disappearance. However, when the camera zooms up 
(the point of view approaches the main point of view) to 
enhance game excitement, especially thick lines are 
displayed, which are unnatural. 
[0015] In view of the aforementioned problems, an 
object of the present invention is to provide an image 
processing device and method allowing games to be 
processed in a more realistic and immediate manner 



during image processing for soccer games and the like, 
so as to allow the more recent requirements of game 
devices to be adequately dealt with. 
[0016] Another object of the present invention is to 
5 achieve more accurate simulation, so that the move- 
ments of the characters are more like the movements of 
actual competitors during image processing of games 
such as soccer games, resulting in a more realistic 
game. 

10 [0017] Yet another object of the present invention is to 
more realistically represent the movements of specta- 
tors during image processing of games such as soccer 
games, resulting in far greater game immediacy 
[0018] Another object of the present invention Is to 

15 provide a screen in which the color display is adjusted 
according to the state of the light source in the environ- 
ment of the time zone in which players are actually play- 
ing a game during image processing of ^mes such as 
soccer games, further enhancing game immediacy 

20 [0019] An object of the present invention is to provide 
novel means for suggesting game situations to players 
based on the actions of more accurately simulated char- 
acters, and novel- means for adjusting the playability of 
the game. 

25 [0020] An object of the present invention is to provide 
a more easily seen game screen ensuring the display of 
ot^ects that are necessary to the players, in such a way 
that objects which have a specific function in three- 
dimensional virtual game space but which tend to dis- 

30 appear in the conversion to two-dimensional images still 
remain in the two-dimensional game screen even when 
they are smaller. 

[0021 1 An object of the present invention is to provide 
an image processing device for controlling the eye 
35 direction and direction of the camera or the position of 
the virtual camera according to the relative positional 
relation between the virtual camera and characters or 
areas in the game field, and for forming a saeen with a 
more favorable perspective for the player in such areas. 

40 

DISCLOSURE OF THE INVENTION 

[0022] To achieve the aforementioned objects, the 
image processing device of the present invention is a 

45 device that displays the behavior of characters modeled 
on opponents in virtual three-dimensional space, com- 
prising determination means for determining whether or 
not there exists a certain situation in which the relation 
to the game contents or the positional relation (such as 

so distance) between characters and a target (imaginary 
point) having a relation through the game to the afore- 
mentioned characters matches certain conditions, and 
eye direction control means for directing the eye direc- 
tion of the aforementioned characters to the aforemen- 

55 tioned objects when the determination means has 
determined the aforementioned certain situation exists. 
Any imaginary point in virtual space can be used 
instead of the target point. 
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[0023] For example, when the aforementioned game 
is a soccer game, the aforementioned target is a ball in 
the aforementioned soccer game. For example, the 
aforementioned eye direction control means may 
include means for rotating and controlling the torsos 
and waists of the aforementioned characters with the 
rotation of the heads of the aforementioned characters. 
The aforementioned determination means may include, 
for example, means for computing the angle from the 
aforementioned characters to the target based on coor- 
dinate values of the aforementioned characters and the 
aforementioned target in the aforementioned virtual 
three-dimensional space. 

[0024] There are preferably a plurality of the afore- 
mentioned objects, and the aforementioned determina- 
tion means pr^erably includes determination means for 
determining to which of the aforementioned plurality of 
targets the eye direction should be directed according to 
the aforementioned game situation. 
[0025] The image processing method of the present 
invention is a method for displaying the behavior of 
characters modeled on opponents in virtual three- 
dimensional space, wherein a determination is made as 
to whether or not there exists a certain situation in which 
the relation to the game contents or the positional rela- 
tion between characters and a target having a relation 
through the game to the aforementioned characters 
matches certain conditions, and the eye direction of the 
aforementioned characters is directed to the aforemen- 
tioned target when it has been determined that the cer- 
tain situation exists. 

[0026] In the image processing method of the present 
invention, a determination is made as to whether or not 
certain conditions have been established while the 
aforementioned character is made to execute a first 
behavior, and the aforementioned character is made to 
execute a second behavior when the aforementioned 
certain conditions have been established, so that infor- 
mation on the developing game situation is suggested 
(or inrplied) to the player. 

[0027] The image processing device of the present 
invention is a device for displaying the behavior of spec- 
tators in stands facing the playing field, comprising a 
plurality of polygons individually mapped with textures 
modeled on a plurality of spectators, the aforemen- 
tioned plurality of polygons being virtually superposed, 
and polygon oscillation means for moving the plurality of 
polygons in the directions intersecting the directions in 
which the polygons are superposed. 
[0028] The aforementioned plurality of polygons are 
preferably virtually superposed, while the plurality of 
polygons that form the various plurality of objects are 
interleaved according to the sequence of objects, and 
the aforementioned polygon oscillation means is prefer- 
ably a means for periodically moving the aforemen- 
tioned plurality of objects while synchronized and linked 
with each object. The aforementioned moving direction 
is preferably the vertical or lateral direction of the afore- 



mentioned polygons. 

[0029] The image processing method of the present 
invention is a method for displaying the behavior of dis- 
play spectators in stands lacing the playing field in vir- 

5 tual three-dimensional space, wherein a plurality of 
polygons individually mapped with textures modeled on 
a plurality of spectators are virtually superposed, and 
the aforementioned plurality of polygons are moved in 
directions intersecting the directions in which the poly- 

10 gons are superposed. 

[0030] The image processing device of the present 
invention is a device for simulating and displaying 
games in virtual three-dimensional space, comprising 
sensing means for sensing the time of the aforemen- 

15 tioned game being played by a player, and adjusting 
means for partially or completely adjusting the screen 
colors of the aforementioned images according to the 
time sensed by the sensing means. For example, the 
aforementioned adjusting means may comprise mem- 

20 cry means by which data on predetermined screen 
color states of at least two standard time zones with 
brightness most suited to the game during the day are 
stored in the form of various reference values, and data 
generating means which, when the game time sensed 

25 by the aforementioned sensing means is within either of 
the aforementioned standard time zones, generates 
masking data for the game display screen based on the 
corresponding one of the aforementioned reference val- 
ues, and which, when the aforementioned time is not 

30 within either of the aforementioned standard time 
zones, generates the aforementioned masking data 
based on data for the screen color state interpolated on 
the basis of the two reference values temporally prior to 
and following the aforementioned time in the aforemen- 

35 tioned at least two reference values. 

[0031] The image processing method of the present 
invention is a method for simulating and displaying 
games in virtual three-dimensional space, wherein the 
real time during the day in which the player plays the 

40 aforementioned game is sensed, and the screen color 
of the aforementioned images are adjusted according to 
the real time. 

[0032] The image processing device of the present 
invention is an image processing device for situating 

45 objects in virtual space formed by a computer system, 
developing a game white controlling the movements of 
the aforementioned olDjects according to input control 
and set rules, and displaying circumstances in the 
aforementioned virtual space as the screen seen from a 

so virtual camera, comprising polygons situated on a refer- 
ence plane serving as the reference in the aforemen- 
tioned virtual space, determination means for 
determining the positional relation between the afore- 
mentioned polygons and the aforementioned virtual 

55 camera, and polygon tilting means for tilting the afore- 
mentioned polygons, accorcfing to the results of the 
determination, so as to increase the surfeice area of the 
aforementioned polygons seen from the afbremen- 
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tioned virtual camera. 

[0033] The aforementioned reference plane is prefer- 
ably the ground, and the aforementioned polygons are 
preferably polygons forming lines situated on the afore- 
mentioned ground. 

[0034] The aforementioned polygons have a plurality 
of sides, and the aforementioned polygon tilting means 
modifies the coordinate values of the vertices on one of 
the sides of mutually facing sides of the aforementioned 
polygons. 

[0035] The image processing device of the present 
invention is an image processing device for situating 
objects in virtual space formed by a computer system, 
developing a game while controlling the movements of 
the aforementioned objects according to input control 
and set rules, and displaying circumstances in the 
aforementioned virtual space as the screen seen from a 
virtual camera, comprising determination means for 
determining whether or not the aforementioned objects 
are in a specific area in the aforementioned virtual 
space, and camera angle adjusting means for adjusting 
the angle of the aforementioned virtual camera based 
on the results of the aforementioned determination. 
[0036] The aforementioned camera angle adjusting 
means preferably adjusts the angle of the aforemen- 
tioned virtual camera based on the results of the afore- 
mentioned determination and the direction in which the 
aforementioned objects are moving. 
[0037] The aforementioned camera angle adjusting 
means preferably adjusts the angle of the aforemen- 
tioned virtual camera in at least one of either the lateral 
and vertical directions in the aforementioned virtual 
space. 

[0038] The image processing device of the present 
invention is a device for situating objects in virtual space 
formed by a conputer system, developing a game while 
controlling the movements of the aforementioned 
objects according to input control and set rules, and dis- 
playing circumstances in the aforementioned virtual 
space as the screen seen from a virtual camera, com- 
prising determination means for determining whether or 
not the aforementioned objects are in a specific area in 
the aforementioned virtual space, and zoom adjusting 
means for adjusting the range of the field of vision of the 
aforementioned virtual camera based on the results of 
the aforementioned determination. 
[0039] The image processing device is an image 
processing device having an image generating display 
means for converting virtual space constructed with a 
three-dimensional nrxxiel consisting of a plurality of pol- 
ygons to two-dimensional images seen from a virtual 
camera in any position, and displaying them on a dis- 
play device, comprising angle computing means for 
computing the angle between an eye direction vector 
showing the direction in which the aforementioned vir- 
tual camera is facing (camera eye direction) and a nor- 
mal line vector showing the orientation of the plane of 
certain polygons situated in the aforementioned virtual 



space, and polygon tilting means for changing the coor- 
dinate values of the vertices of the aforementioned pol- 
ygons, so that the angle computed by the 
aforementioned angle computing means assumes a 

5 certain value. 

[0040] The image processing device of the present 
invention is an image processing device having image 
generating display means for generating two-dimen- 
sional images that reveal, from any point of view (or a 

10 virtual camera), virtual space constructed with a three- 
dimensional model consisting of a plurality of polygons, 
and for displaying them on a display device, wherein the 
aforementioned polygons comprising nondisappearing 
polygons which have attributes preventing them from 

15 disappearing and which contain data for operating a 
program to prevent polygons from disappearing, the 
aforementioned disappearance prevention program 
comprises position determination means for determin- 
ing the positional relation between the aforementioned 

20 nondisappearing polygons and the aforementioned 
point of view, and coordinate modification means for 
modifying the coordinate values of the vertices of the 
aforementioned nondisappearing polygons according to 
the results of the determination by the aforementioned 

25 position determination means, and the aforementioned 
image processing device furthermore comprises disap- 
pearance prevention execution means for executing the 
aforementioned disappearance prevention program 
when the polygons visualized on the aforementioned 

30 display device are the aforementioned nondisappearing 
polygons. 

[0041 ] The data recording media of the present inven- 
tion record a program for allowing a computer system to 
function as any of the aforementioned image process- 
35 ing devices. 

BRIEF DESCRIPTION OF THE DRAWINGS 
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[0042] 



Fig. 1 is a block diagram depicting the functional 
structure of the game machine in an embodiment of 
the present invention; 

Rg. 2 is a schematic flow chart outlining the CPU 
processing: 

Fig. 3 illustrates the angle computation in the con- 
trol of the eye direction; 

Rg. 4 illustrates the angle computation in the con- 
trol of the eye direction; 

Rg. 5 illustrates the appearance of a character dur- 
ing control of the eye direction;; 
Rg. 6 is a schematic flow chart depicting an exam- 
ple of the control of the eye direction; 
Fig. 7 is a schematic flow chart depicting an exam- 
ple of the control of the eye direction along with Rg. 
6; 

Fig. 8 illustrates the data structure of the spectator 
data based on polygons; 
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Fig. 9 is a schematic flow chart depicting an exam- 
ple of processing to control the behavior of specta- 
tors; 

Fig. 10 illustrates a frame in an example of the con- 
trol of spectator behavior; s 
Fig. 1 1 illustrates another frame in an example of 
the control of spectator behavior; 
Fig. 12 illustrates another frame in an example of 
the control of spectator behavior; 
Fig. 13 illustrates another frame in an example of io 
the control of spectator behavior; 
Fig. 14 illustrates another frame in an example of 
the control of spectator behavior; 
Fig. 15 illustrates another frame in an example of 
the control of spectator behavior; is 
Fig. 16 illustrates another frame in an example of 
the control of spectator behavior; 
Fig. 17 illustrates another frame in an example of 
the control of spectator behavior; 
Fig. 18 is a schematic flow chart relating to an so 
example of fog control; 

Fig. 19 Illustrates time zone division for fog control; 
Fig. 20 illustrates an example of a display screen 
based on fog control; 

Fig. 21 illustrates another example of a display 2S 
screen based on fog control; 
Fig. 22 Is a schematic of an Image displayed on a 
screen as a result of the control of the eye direction 
of a character; 

Fig. 23 Illustrates an example of the overall struc- so 
ture of a game device; 

Ftg. 24 is a block diagram Illustrating the circuit 
structure of the game device; 
Fig 25 illustrates the virtual game space formed by 
the game device; 3S 
Fig. 26 illustrates the perspective of a line drawn 
between the camera position and the ground; 
Fig. 27 illustrates a process in which the vertices on 
the inside edge of line polygons are elevated to 
make the line visible; 

Fig. 28 is a flow chart illustrating the process for 
preventing the lines from disappearing; 
Fig. 29 illustrates the positional relation between 
the camera and the vertices of the line polygons; 
Rg. 30 Illustrates the positional relation between 45 
the camera and the vertices of the line polygons; 
Fig. 31 illustrates an example of the data for the ver- 
tices of the line polygons; 

Fig. 32a illustrates the movement of a player away 
from and toward the viewer; so 
Fig. 32b illustrates the direction of the normal line 
vector of the camera at this time; 
Fig. 33a illustrates the lateral movement of a player; 
Fig 33b illustrates the direction of the eye direction 
vector of the camera at this time; ss 
Fig. 34a illustrates the lateral movement of a player; 
Fig. 34b illustrates the direction of the eye direction 
vector of the camera at this time; 



Fig. 35 is a flow chart depicting the process for 
adjusting the lateral angle of the camera; 
Fig. 36 is a continuation of the flow chart illustrating 
the process of adjusting the lateral angle of the 

camera; 

Fig. 37 illustrates a case in which the main point of 

view of the camera is from a player; 

Fig. 38 Illustrates and exanrple of the adjustment of 

the camera angle when the main point of view Is 

within 8 m of a penalty area; 

Fig. 39 illustrates a case in which the player's 

progress is toward the viewer; 

Fig. 40 Illustrates a case in which the player's 

progress is away from the viewer; 

Fig. 41 illustrates an example of the eye direction 

vector of the camera when the player's progress is 

away from and toward the viewer; 

Fig. 42 illustrates an example of a player moving to 

the left; 

Fig. 43 illustrates the camera angle adjustment 
when the player moves to the left; 
Rg. 44 Illustrates an example of the player moving 
to the right; 

Fig. 45 illustrates the camera angle adjustment 

when the player moves to the right; 

Fig. 46 Illustrates an example of when the main 

point of view of the camera Is from the ball; 

Fig. 47 illustrates an example of the camera angle 

adjustment when the ball and player are separated 

by at least 15 m; 

Fig. 48 illustrates another example of the camera 
angle adjustment when the ball and player are sep- 
arated by at least 15 m; 

Fig. 49 illustrates a case in which the main point of 
view of the camera is within 8 m of a penalty area; 
Fig. 50 illustrates the camera angle adjustment 
when the main point off view of the camera Is within 
8 m of a penalty area; 

Fig. 51 illustrates a case in which the main point of 
view is not within 8 m of a penalty area; 
Fig. 52 illustrates the camera angle adjustment 
when the main point of view Is not within 8 m of a 

penalty area; 

Fig. 53 is a flow chart illustrating the vertical angle 
adjustment of the camera; 

Fig. 54 Illustrates the vertical angle adjustment of 
the camera; 

Fig. 55 is a flow chart illustrating the camera zoom 
adjustment. Fig. 56 illustrates an area in which the 
player Is present on the screen; 
Fig. 57 is a flow chart illustrating another example 
of an object prevented from disappearing; 
Fig. 58 illustrates an object prevented from disap- 
pearing; 

Fig. 59 Is another example of texture Including 
spectators; 

Fig. 60 is another example thereof; 

Rg. 61 Is an embodiment of texture displ^ when 
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polygons mapped with textures are superposed; 
Fig. 62 is an embodiment for moving polygons; and 
Fig. 63 is another embodiment. 

BEST MODE FOR CARRYING OUT THE INVENTION s 

[0043] A first embodiment of the present invention is 
described below with reference to Figs. 1 through 22. a 
second embodiment is described with reference to Figs. 
23 through 31, and a third embodiment is described io 
with reference to Figs. 32 through 58. These embodi* 
ments relate to games integrally incorporating the 
Image processing device of the present invention. The 
application software in these cases assume soccer 
game software as an example, but they may similarly be is 
implemented with other types of software such as that 
for baseball games, soft ball games, and basket ball 
games. 

[0044] Fig. 1 schematically illustrates the block struc- 
ture of the game device pertaining to the first embodi- 20 
ment. The game device has a CPU (central processing 
unit) 1 , with ROM 2, RAM 3. an input device 4, and a 
video display processor (VDP) 5 all connected by a bus 
to this CPU 1. The CPU 1 sequentially executes the 
game program previously stored in ROM 2. The various 25 
processes pertaining to the present invention are real- 
ized as the VDP 5 periodically executes the program 
stored in ROM 2. Three processes relating to the 
present invention include the process by which the sight 
of line of the characters is controlled, the process by 30 
which spectator behavior is controlled, and the process 
of fog control in the form of display screen color adjust- 
ment. In addition to the program processed by the CPU 
1 or VDP 5, character polygon data as well as the pro- 
grams and fixed data necessary for the three processes 35 
(such as spectator polygon data and fog reference data) 
are previously stored in ROM 2. 
[0045] The operating RAM 3 temporarily stores vari- 
ous types of data during the execution of the game. The 
input device 4 is equipped with an instrument operated 40 
by the player, such as a joy stick, and is used to input the 
data necessary for executing the game, such as when 
controlling the movement and motions of characters. 
[0046] A video RAM (VRAM) 6, imaging device 7. and 
operating RAM 8 are connected to the VDP 5. Polygon 45 
data from ROM 2 is stored in VRAM 6. The polygon 
data comprises coordinate data for the number of verti- 
ces which are to be displayed and color data given in 
the form of color palettes for the vertices. The VDP 5 
has a digital signal processor (DSP). In response to so 
periodic timing signals such as the frame switching tim- 
ing, the VDP 5 actuates and executes an image 
processing-dedicated program previously stored in 
ROM 2. The coordinates of the polygon data stored in 
VRAM 6 are converted and processed as a result of ss 
processing by the BDP 5. and are transferred to the 
imaging device 7. 

[0047] A texture ROM 9 and frame buffer memory 10 
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are connected to the imaging device 7. Texture is 
mapped by the imaging device 7 to the polygon data 
which has undergone coordinate conversion, and is 
written in the form of pixel data per frame (screen) to the 
frame buffer memory 10. 

[0048] The frame buffer memory 1 0 is connected by a 
D/A converter 11 to an image processing device 12 
such as a CRT The D/A converter 1 1 functions as a 
video signal generating circuit, reading pixel data from 
the frame buffer memory 10 and converting It to analog 
signals. The converted data is sequentially sent in the 
form of video signals to the display device 12, and 
images are displayed. 

[0049] The game device also comprises a fog circuit 
13 and real time clock 14 which are connected to the 
bus BUS. The real time clock 1 4 has a time arxJ calen- 
dar function, so as to give real daily time data to the 
CPU 1. As is described below, the fog circuit 13 has 
what is referred to as a "fog function." which involves 
adjusting the display screen color through masking 
using specially established color data, referred to as fog 
data, according to the time in which the game device is 
operated (that is, the real daily time in which the game 
device is being played by a player), and generates fog 
data under the control of the CPU 1 and transmits it to 
the VDP 5. 

[0050] Rg. 2 illustrates an example of processing per 
frame executed by the CPU 1 . First, the CPU 1 receives 
from the input device 4 character motion commands 
(such as running, turning, and kicking the ball) corre- 
sponding to operating data from the player, and com- 
putes the motion of characters in three-dimensional 
virtual space (81). 

[0051] The CPU 1 then processes the ball (S2) in 
three-dimensional virtual space, such as advancing the 
soccer ball position, and processes collisions (hits) (S3) 
in three-dimensional virtual space. The collision 
processing is the determination and processing of vari- 
ous types of collisions, such as that between characters 
and the ground, between characters, and between char- 
acters and the ball. The CPU 1 then processes the 
tsehavior of the characters (robots) operated by the 
player in three-dimensional virtual space in response to 
operating data from the player (S4). 
[0052] The CPU 1 also processes the control of the 
^e direction of the characters (S5). This control of the 
^e direction constitutes a characteristic feature of the 
preserrt invention in an effort to provide more diverse 
character action during the game and to enhance the 
realism of the soccer game. This process is described in 
detail below. 

[0053] When the process for controlling the eye direc- 
tion is complete, the CPU 1 processes the soccer game 
field (S6). This field processing involves issuing com- 
mands for processes necessary to the game as the 
positions of the characters present in the field in virtual 
three-dimensional space are used as reference to 
determine which characters are in the offside line and 
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which characters are in the goal area so as to advance 
the game. 

[0054] The CPU 1 then processes the control of spec- 
tator behavior (S7) and issues connnnands for fog control 
(S8). These two processes also constitute part of the s 
characteristic features of the present invention. The 
process of controlling spectator behavior is an attempt 
to enhance realism and immediacy by representing a 
variety of spectator behaviors while suppressing the 
computing load, and is described in detail below. The io 
process of fog control is an attempt to enhance realism 
and immediacy by controlling the brightness of the 
screen according to the time throughout the day (color 
adjustment based on whether the game is played during 
the day or at night) in which the game is actually being is 
played by the player, and is described in detail below. 
Finally, other necessary processing is executed (S9). 
[0055] Only the main point of view of the character is 
determined in the control of the point of view in step S5; 
the motion of actually turning a character may be man- 20 
aged in the subsequent processing time SI . Step S4 
may be similarly managed. In other words, a timing of at 
most about 1/60 second can be established from the 
data acquisition and determination of the main point of 
view until the motion is actually carried out in the rele- 25 
vant direction. 

[0056] The CPU 1 repeats the aforementioned 
processing for each frame. Thus, as the game unfolds, 
the GPU 1 sends commands for motion and the like cor- 
responding to the manipulations of the player to the 30 
VDP 5. The necessary polygon data is transferred from 
the ROM 2 to the VDP 5 under the control of the CPU 1 . 
The VDP 5 temporarily stores the polygon data in the 
VRAM 6. the polygon data undergoes coordinate con- 
version from virtual three-dimensional space to per- 35 
spectlve two-dimensional space according to the 
commands, and the converted coordinates are trans- 
ferred to the imaging device 7. The imaging device 7 
maps texture to the polygon data that has undergone 
coordinate conversion and writes it to the frame kxiffer 40 
memory 10. As a result, images with new pixel data are 
displayed on the display device 12 for each frame. 
[0057] The process for the control of the aforemen- 
tioned character eye direction is described below with 
reference to Figs. 3 through 7. This process is the step 45 
executed in step S5 in Fig. 2. 

[0058] The principles of angle computation determin- 
ing the direction of the eye direction of a character C are 
described first. Here, the character C is assumed to be 
located at coordinates (Xp. Yp. Zp) in three^limensional so 
virtual space, and the soccer ball B serving as the target 
is located at coordinates (Xt. Yt. Zt) in the same space 
In this case, based on the geometry viewed from the 
direction of the Y axis in Fig. 3, the following values can 
be calculated: ss 

X' = Xt - Xp 



2' = Zt - Zp 

and the angle ey and distance L on the X-Z plane 
between the character C and the ball B can be calcu- 
lated from the values X' and Z\ Similarly, the distance L 
between the character C and the ball B on the horizontal 
axis can be obtained based on this geometry, and the 
geometry obtained when the vertical axis is the Y axis 
can be imagined as depicted in Fig. 4. In other words, 
the coordinates (Yp. l_p) for the character C and the 
coordinates (Yt. Lt) for the ball B can be determined. In 
this case, the values 

r = Yt - Lt 
L ' = U - Lp 

can be calculated, and the angle Oy at which the 
character C sees the ball B on the Y-L plane can be cal- 
culated based on Y* and L'. In other words, the eye 
direction when each character looks at the ball, for 
example, is determined by the parameters Oy. L. and Ox. 
The target is not limited to the ball, and can be similarly 
calculated when another player, the goal, or referee. In 
other words, it may be managed by giving the coordi- 
nates of one's own character and the coordinates of a 
given point for another player or referee or the coordi- 
nates of a central position such as of a goal. 
[0059] The direction of the eyes is determined in this 
manner, but the character's body faces in a variety of 
directions (way of turning) while his eyes are directed in 
that direction. Rg. 5 illustrates this. In the present 
embodiment, the head HD, torso BD. and waist HP of 
the character C are given as components where the 
body turns (rotates) during the control of the eye direc- 
tion. Thus, modes of turning such as 

1) when the head HD turns first (vertical or lateral 
turn), the torso BD then turns, and the waist HP 
then turns; 

2) when the head HD and torso BD first turn simul- 
taneously, and the waist HP then turns; and 

3) when only the torso HD turns 

can be controlled for each situation in which the 
character is situated for each game scenario. This con- 
trol may be managed, for example, by storing the angle 
to which each part HD, BD, and HP turns per frame, giv- 
ing commands for motion based on a slight increase in 
the angle of the current turning angle in subsequent 
frames, and terminating the turning motion commands 
at the frame where the calculated angles Sx and Oy are 
reached for each body part. 

[0060] In general, the movements of the human body 
are based on natural structural principles, and body 
movements appear most natural if these natural princi- 
ples are applied when characters are set in motion. For 
example, when a body is turned, as indicated in Fig. 5. 
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the neck turns the most rapidly, followed by the upper 
half of the body, and lastly by the entire body Thus, 
when a body is turned, the neck should turn faster than 
the upper half of the body, and the upper half of the 
body should turn faster than the whole body 
[0061] By having the torso BD begin to turn when the 
turning angle of the head HD reaches a certain value, 
the turning body may be represented as the turning tim- 
ings of the head, torso, and waist are staggered. 
[0062] Figs. 6 and 7 depict an example of the process 
for controlling the eye direction determined in this man- 
ner. The procedure for controlling the character eye 
direction can assume various forms. What is shown 
here is only an example, and the present invention is in 
no way limited to the examples. The process of control- 
ling the eye direction may be carried out for all competi- 
tors (characters) on the field, or it may be carried out for 
only characters in a designated visual field to alleviate 
the computing load. It may even be carried out for only 
specific characters within the designated visual field, 
such as characters of particular concern (for example, 
characters in motion related to the ball or characters 
under the control of the player (individual playing the 
game device)). 

[0063] As indicated in Fig. 5, for example, it is deter- 
mined whether or not a given character is currently run- 
ning, either YES (running) or NO (not running) (S21). If 
YES, it is furthermore determined whether or not the 
other team has the bail (822). If the determination is 
YES (the other team has the ball), it is further deter- 
mined whether or not a character on the other team is 
dribbling (S23). If YES (is dribbling), it is determined on 
the basis of the calculated distance values whether or 
not the dribbling character is within 3 meters (S24). If 
YES (within 3 meters), the eye direction of the character 
currently being controlled is directed toward the ball 
(S25). In the process of step 25. the turning process in 
Fig. 5 above is added. For example, since the character 
in step 25 is running, turning mode 1) is suitable, for 
example, in directing the character's eye direction to the 
bait while running. 

[0064] If NO (not within 3 meters) in step S24. the eye 
direction of the character currently being controlled is 
directed to the character that is dribbling (S26). The 
turning corttrol at this time may be in any of the forms 
described with reference to Fig. 5, and should be 
selected according to the type of angle relation with the 
other character at this time. 

[0065] If NO (not dribbling) in step S23, and if NO 
(opposing team does not have the bail) in step S22, it is 
determined whether or not the current ball behavior is a 
"Ngh ball" (S27). Here, a "high ball" is when the bail 
position is higher than the heads of the characters. If 
YES (high ball), a command is given to the character 
currently being controlled to direct his eyes to the ball 
(S28). On the other hand, if NO (not a high ball), the eye 
direction is not controlled, and the motion-dependent 
eye direction is maintained (829). For example, since 



• the character is at least running, the eyes are kept in the 
direction in which the character is running. "Motion 
dependent" means when the eye direction is not con- 
trolled and the movement of the character's action pat- 
5 tern (motion) determined by the program is used without 
further modification. 

[0066] If NO in step 821. that is. when it has been 
determined that one's own character is not running, it is 
sequentially determined whether the character is drib- 
10 ding (Fig. 7, S30) or is in the centering area (S31). If 
YES in step 31 , since the character is dribbling and is in 
the centering area, the character will naturally aim at the 
goal. In this case, the character's eyes are directed at 
the goal (832). 

15 [0067] When the character is not in the centering ring 
in step 831 . the character's eyes are directed to the top 
athlete at a rate of once every 4 seconds (833). for 
example, and the character's eyes are directed to the 
goal at a rate of once every 4 seconds (S34). If NO (not 

20 dribbling) in step 830, it is determined whether or not 
the game is in set play (835). If YES (set play), it is 
determined whether or not another character has 
decided to pass and is ready to kick (S37). and if YES. 
the eye direction Is directed to the passing character 

25 (837), whereas if NO, a motion-dependent eye direction 
is maintained without any special control of the eye 
direction (838). 

[0068] Fig. 22 schematically depicts a screen display- 
ing the results of the control of a character's eye direc- 
30 tlon. In the figure, athlete A directs his line of vision in 
the direction of athlete B (feet) who is the passing char- 
acter. Athlete B directs his line of vision in the direction 
of the ball to be passed. 

[0069] Controlling the character's eye direction in this 

35 manner allows the sports behavior of actual soccer 
games to be simulated far more closely. The eye direc- 
tion is not longer the kind in which the ball is suddenly 
kicked in another direction while the character is facing 
the direction In which he Is running, for example, as in 

40 the past. In such cases as well, the character's eyes are 
first directed in the direction of the kick or the intended 
kick, so the character's behavior can be more realisti- 
cally portrayed, and a more exciting game device with 
better immediacy can be provided. Furthermore, when 

45 the eye direction is being controlled, not only the head is 
turned, but the torso or waist are also turned, either con- 
secutively or simultaneously, as needed, allowing the 
behavior during the control of the eye direction to be 
realized in a more realistic manner. 

so [0070] Another advantage of the aforementioned con- 
trol of the eye direction is that the direction in which the 
character's eyes are directed itself gives clues (sug- 
gests) to the player (Individual playing the game device) 
what the character's next move will be. For example. 

55 when a dribbling character begins to cfirect his eyes fre- 
quently behind, it may be concluded that a character 
from the other team is approaching from behind, allow- 
ing the player (individual playing the game device) to 
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avoid pursuit. The behavior of the characters can thus 
telegraph (suggest) situations in the game to the player 
(individual playing the game device). 
[0071] Conversely, it is possible to make misleading 
suggestions in the determination steps in Figs. 6 and 7. s 
In other words, the eye direction can be deliberately 
directed in a direction completely different from the 
actual determination. This can confuse the judgment of 
the player (individual playing the game device), can fur- 
ther enhance the Interest and excitement of the game io 
device, and can increase the game difficulty. 
[0072] The process of controlling spectator behavior 
is described below with reference to Figs. 8 through 17. 
[0073] The structure of the image data (spectator 
data) for portraying the spectators in the present inven- is 
tion is described first with reference to Fig. 8. First, 
spectators are sitting in stands In which m (> 2) columns 
of seats are increasingly higher the further back the 
stands go. and the spectators in these m columns are 
divided into n (> 2) rows. Of these "m columns x n rows," 20 
"m* columns x n rows" of spectators per m' column (> 0) 
are represented by mapping textures containing a plu- 
rality of spectators onto each rectangular polygon. For 
example, Fig. 8 shows the data structure in virtual 
space, where A through D. A' through D\ and A" 25 
through D" indicate 12 rectangular polygons, and the 
polygons are layered based on a pattern which is 
increasingly higher in the depthwise direction of the 
stands. Each of polygons A through D, A' through D', 
and A" through D" is a single polygon, representing a so 
plurality of spectators in 3 column (=m') x 4 row (=n) 
portions, for example. The second polygon B located in 
virtual space behind (depthwise direction) the first poly- 
gon A assumes an initial state that is one column higher, 
for example, the third polygon C assumes an initial state 3S 
that is one column higher, for example, and the fourth 
polygon D assumes an Initial state that is one column 
higher, for example. As such, "14 columns x 4 rows" of 
spectators, for example, are ranked in the stands by 
means of the 12 polygons A through D, A' through D\ 40 
and A" through D". 

[0074] The first four polygons A through D. for ©cam- 
ple, among the 12 polygons A through D, A' through D'. 
and A" through D" are mutually connected in a specta- 
tor pattern, the next four polygons A* through D' are 45 
mutually connected in a spectator pattern, and the last 
four polygons A" through D" are mutually connected in 
a spectator pattern. At the same time, three polygons - 
the first, fifth, and ninth polygons A. A', and A" among 
the 12 polygons A through D. A' through D'. and A" sc 
through D" constitute one object OBI in which they 
move in the same manner. Similarly, another three pol- 
ygons ~ the second, sixth, and tenth polygons B. B', and 
B" constitute one object OB2 in which they move in 
the same manner. Another three polygons - the third, si 
seventh, and eleventh polygons C, C\ and C" -- similarly 
constitute one object OB3. and another three polygons 
- the fourth, eighth, and twelfth polygons D, D'. and D" 



-constitute one object OB4. The spectator patterns of 
each object are not connected. That is. a characteristic 
feature of the spectator data in the present invention is 
that a plurality of polygons constitute one object while 
separated form each other in virtual space. The specta- 
tor patterns of each object need not be connected. 
[0075] The process of controlling spectator behavior 
shown in Fig. 9 is executed by the GPU 1 using the data 
structured in this manner. That is. the CPU 1 deter- 
mines the polygon groups whose behavior is controlled 
among all of the spectator data polygons (S41). Thus, 
any group of spectator polygons (such as the 12 poly- 
gons A through D. A' through D', and A" through D" in 
Fig. 10) ranked on the side of the team whom they are 
cheering, for example, may be selected from among the 
spectators seen from the virtual camera (point of view). 
A plurality of polygon groups may also be selected, of 
course. 

[0076] The CPU 1 then selects a behavior pattern to 
move the determined (selected) polygon groups (S42). 
Patterns in which one or several groups of polygons are 
moved up and down (vertically) or side to side (laterally) 
have been prepared as behavior patterns. When the 
behavior pattern is selected, the CPU 1 executes the 
process for moving the one or more groups of polygons 
according to the selected behavior pattern (S43a 
through S43n). 

[0077] Figs. 1 0 through 1 7 depicts examples of ways 
to move the polygons. The polygon group in these fig- 
ures is an example of one group and has the same data 
structure as in Fig. 8. Fig. 1 0 shows the state before the 
polygons are moved, and the state sequentially 
changes frame by frame to the states of the polygon 
positions shown in Figs. 11. 12, 13, 14, 15. and 16. 
returning after several frames to the state of the polygon 
positions shown in Fig. 17 (same as Fig. 10). 
[0078] Specifically in the first new frame shown in Rg. 

1 1 , The first fifth, and ninth polygons A, A', and A" from 
the front constituting the first object OBI are raised up in 
virtual space (up). In the next new frame shown in Fig. 

12, the three polygons A, A', and A" of object OBI are 
raised further up (up), and the secorKl, sixth, and tenth 
polygons B, B*. and B" constituting the second object 
OB2 are raised up (up). In the next new frame depicted 
in Fig. 13. the polygons A, A*, and A" of the object OB1 
drop down in virtual space (down), the polygons B, B\ 
and B" of the second object OB2 are raised further up, 
and the third, seventh, and eleventh polygons C, O. and 
C" constituting the third object OB3 are raised up (up). 
In the next new frame depicted in Fig. 14, the polygons 

B. B*. and B" of the second object OB2 and the polygons 

C, C, and C" of the third object OB3 drop down (down), 
and the three polygons D, D'. and D" of object OB4 are 
raised up (up). In the next new frame depicted in Fig. 1 5, 
the polygons c. C. and C" of the third object 0B3 and 
the polygons D, D\ and D" of object OB4 drop down 
(down). In the next new frame, the polygons D. D\ and 
D" of object 0B4 which drops down more slowly drops 
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further down (down). Thus, as shown in Fig. 17, the 
sequence returns to the initial state of the polygon posi- 
tions. The polygons may similarly be moved side to 
side. 

[0079] The spectator data of the portion seen from the 
virtual camera is designated by the CPU 1 to the VDP 5 
each time one or more groups of polygons are moved 
(from the state in Fig, 1 0 to that in Fig. 1 1 . for example) 
(S44). The process subsequently returns to the process 
in step S41 , repeating the aforementioned behavior pat- 
tern control process for each new frame. This process 
for controlling the behavior of the spectators can be exe- 
cuted for groups of display frames instead of frame-by- 
frame to simplify the process. The process for control- 
ling spectator behavior may also be executed during 
certain modes (such as during goals). The display 
objects in three-dimensional virtual space are displayed 
with changing perspective, relative to the display 
screen, from a certain point of view of the virtual camera 
in virtual space (which can be moved by the individual 
playing the game device). Just to be sure, the point of 
view in the control of a character's eye direction and the 
point of view corresponding to the projected center and 
the position of the virtual camera should be separate. 
[0080] As a result, a plurality of polygons are con- 
nected as a single object, the polygons in a plurality of 
groups are interleaved in cross-sectional groupings, 
and each group is textured with connecting patterns, so 
that the diverse behavior of constantly moving specta- 
tors can be more realistically portrayed simply by mov- 
ing the polygons in their object units. Because they 
move in object units, software design can be simplified 
with fewer commands, for example. 
[0081 ] The behavioral control itself is simple, resulting 
in lower computing loads for such control. The control 
can be done with far less data to handle, while display- 
ing behavior far more realistic than when spectators are 
individually portrayed with polygons. As such, less 
memory capacity is needed to store the spectator data. 
Of course, spectator behavior can be displayed more 
realistically and Immediately with less data than when 
such behavior is displayed by animation. 
[0082] The process for fog control mentioned above is 
described below with reference to Figs. 18 through 21. 
This fog control is a process in which one type off mask 
data having color values, as described above, is super- 
posed on image data. This affords a more realistic 
image display which cannot be obtained by just reflect- 
ing on the screen the changes in brightness accompa- 
nying changes in sunlight throughout the day using only 
conventional luminance data. 

[0083] This process is executed by the CPU 1 as 
shown in Rg. 18, for example. The process in Fig. 18 
may also be executed by the VDP 5. 
[0084] The CPU 1 first reads the cunrent time, that is. 
the standard time in which a player (individual playing 
the game device) is playing the game device, from the 
real time clock 13 (S51). It is then determined whether 



or not the time deviates from the predetermined time 
zone serving as reference for daytime, evening, or night 
(S52). The standard time zones for daytime, evening, 
and night are determined as shown in Fig. 19. for exam- 

5 pie. For example, the daytime standard time zone is 
established at a relatively long 6:00 to 16:30, the 
evening time zone is established at 17:00 to 18:30, and 
the night standard time zone is established at 19:30 to 
5:30. The daytime standard time zone is longer 

10 because to avoid differences in game results due to 
changes in screen brightness between players playing 
in the morning and players playing in the evening. 
[0085] When YES In step S52. the predetermined fog 
data parameters for the daytime, evening, and night 

15 standard time zones are read from ROM 2 (S53). The 
three parameters are red, blue, and green fog color 
codes, offset values (indicating fog depth), and density 
(degree to which fog is applied relative to depth), and 
these parameters are predetermined so as to be suited 

20 to the standard time zones. 

[0086] The CPU 1 then computes the fog data, and 
outputs the data in the form of mask data to the VDP 5 
(S54. S55). 

[0087] If NO in step S52, the deviation between the 
25 current time and the standard time zones is calculated 
(S56). For example, when tiie time is 5:45 in the morn- 
ing, the deviation is 15 minutes exactiy midway between 
the night standard reference time zone and that for day- 
time. 

30 [0088] The CPU 1 then reads the fog data parameters 
(R, G. B color codes, offset values, density) for the two 
standard time zones between which the deviant time 
falls (S57). V^hen the time is 5:45, for example, the 
parameters for the night and daytime standard time 

35 zones are read. 

[0089] The offset and density parameter values are 
corrected (S58). For exanrple. when tiie time is 5:45. tiie 
offset values and density are the mean values for 1/2 of 
tiie offset and density values of the night and daytime 

40 standard time zones. When the time is closer to one of 
the standard time zones, the values are averaged (cor- 
rected), with the values of the closer time zone given 
more importance. 

[0090] The offset values and density are determined 
45 by such correction when the time thus deviates from the 
standard time zone, and the fog data is computed and 
output in the same manner as above (S54. S55). 
[0091] This results in the real time display images 
which have been fogged according to the state of sun- 
so light assumed for the time during which the game is 
being played by a player (individual playing the game 
device). For example, when a game is played in the 
evening, the background beyond the playing field has 
darkish fogging (see tiie slanted lines in Fig. 20). When 
55 a game is played at night, for example, the background 
has darkish fogging and yellowish fogging from the 
shine of moon light, assuming the moon is out in the 
back ground (see slanted lines in Rg. 21). 
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[0092] It is thus possible to more realistical ly represent 
spectral changes and the brightness of the light source, 
unlike cases in which the state of the sunlight (physical 
brightness) in the images portraying the playing field 
and its environment is displayed merely through the 5 
control of the luminance as In the past. In particular, 
local brightness such as In portions where the moon is 
out, for example, can be easier to control because of the 
coverage of the color fog data. In the present embodi- 
ment, the subtle brightness of standard time zones such 10 
as when the rising or setting sun is out can be proc- 
essed based on the corrected parameters obtained 
using two standard time zones among those for day- 
time, evening, and night. 

[0093] That is. the color state is determined by prepar* is 
ing in advance the color slate corresponding to suitable 
color states for a daytime, evening, or night game, and 
by making corrections (specifically, processes for mix- 
ing color; luminance values corrected on the basis of 
two sets of standard values may also be added) based 20 
on standard values between daytime and evening, 
evening and night, or night and daytime for color states 
suited to the time in which the game is played. It is thus 
no longer difficult to play the game as the screen dark- 
ens, which is what happens when adjustments are 25 
made using only luminance values. The point at which 
color adjustment begins (one standard value) and the 
point at which it ends (another standard value) are pre- 
determined, and the states which are suitable for games 
are set, so no advantages or disadvantages are pro- 30 
duced by the color state of the screen, no matter what 
time in which the game is played. That is, because of 
the very nature of the game, it is important that "no 
sense of unfairness is experienced as a result of advan- 
tages or disadvantages caused by the time zone in 35 
which the game is played" when "color changes based 
on time changes" are presented, and the device in the 
present embodiment is able to deal with this. It is thus 
possible to provide images with better immediacy in 
portraying the brightness of the environment In which 40 
the playing field and its sun-oundings are enveloped. 
[0094] The aforementioned control of character's eye 
direction, control of spectator behavior, and fog control 
need not necessarily be managed simultaneously. Any 
one or two may be controlled. 45 
[0095] A second embodiment of the present invention 
is described below with reference to Figs. 23 through 
58. 

[0096] Fig. 23 illustrates the appearance of a video 
game machine featuring the use of an image process- sc 
ing device relating to another embodiment of the 
present invention. In the figure, the video game machine 
main unit 50 is roughly in the shape of a box, with 
boards and the like for processing the game installed in 
the interior. Two connectors 60a are provided on the st 
font surface of the video game machine main unit 50, 
and game playing PADs 60b are connected by cables 
60c to the connectors 60a. When two players play the 



game, both PADs 60b are used. 
[0097] A cartridge l/F 50a for connecting ROM car- 
tridges and a CD-ROM drive 50b for reading CD-ROM 
are provided on the top of the vide game machine main 
unit 50. Although not shown in the figure, video output 
terminals and audio output terminals are provided in the 
back of the video game machine main unit 50. The 
video output terminals are connected by a cable 70a to 
the video input terminals of a TV receiver 80. and the 
audio output terminals are connected by a cable 70b to 
the audio input terminals of th TV receiver 80. Users 
operate the PAD 60b in such video game machines to 
play the game while watching images projected on the 
TV receiver 80. 

[0098] Fig. 24 is a block diagram showing a schematic 
of the TB game machine in the present embodiment. 
The innage processing device is composed of a CPU 
block 51 for controlling the entire system, a video block 
52 for controlling the game screen display, a sound 
block 53 for generating sound effects and the like, a 
subs system 54 Ibr reading the CD-ROM, and the like. 
[0099] The CPU block 51 is composed of an SOU 
(system control unit) 100, a main CPU 101, an RAM 
102. and ROM 103, a cartridge l/F 50a. a subCPU 104. 
a CPU bus 103, and the like. The main CPU 101 con- 
trols the entire system. The main CPU 101 has comput- 
ing functions similar to that of an internal DSP (digital 
signal processor), allowing application software to be 
rapidly executed. The RAM 102 is used as a work area 
for the main CPU 101. An initial program or the like for 
initialization is written to the ROM 103. The SCU 100 
controls buses 105, 106. and 107 so as to ensure 
smooth data input and output between the main GPU 
101. VDP 120 and 130, DSP 140, CPU 141, and the 
like. The SCU 100 has a DMA controller installed in the 
interior, allowing sprite data in the game to be transmit- 
ted to the VRAM in the video block 52. Application soft- 
ware for games and the like can thus be rapidly 
executed. The cartridge 50a is used to input application 
software provided in the form of an ROM cartridge. 
[0100] The subCPU 104 is referred to as a SMPC 
(system manager and peripheral control), and has the 
function of collecting peripheral data from the PADs 60b 
through the connectors 60a in response to commands 
from the main CPU 101. The main CPU 101 executes 
processes based on peripheral data received from the 
CPU 104. Any peripheral from among PADs, joysticks, 
keylx>ards, and the like can be connected to the con- 
nectors 60a. The subCPU 104 has the functions of 
automatically recognizing the type of peripheral con- 
nected to the connectors 60a (main unit side terminals), 
and of collecting peripheral data according to the trans- 
mission mode corresponding to the type of peripheral. 
[0101] The video block 52 is equipped with a VDP 
(video display processor) 120 for imaging characters 
and the like consisting of video ganne polygon data, and 
a VDP 130 for imaging background screens, synthesiz- 
ing polygon image data and background images, clip- 



12 



BNSDCCID; <EP p901803A1_L> 



23 



EP0901 803 A1 



24 



ping processing, and the like. The VDP 120 is 
connected to the VRAM 1 21 , and frame buffers 122 and 
123. The imaging data for the polygons representing the 
video game machine characters are sent from the main 
CPU 101 through the SCU 100 to the VDP 120. and are 5 
written to the VRAM 121. The imaging data written to 
the VRAM 121 Is imaged by the imaging frame buffer 
1 22 or 123 In the form of 1 6- or 8-bit/pixels. for example. 
The imaged data in the frame buffer 122 or 123 Is sent 
to the VDP 130. Data controlling the imaging is sent 10 
from the main CPU 101 through the SCU 100 to the 
VDP 120. The VDP 120 executes the imaging process 
accordingly 

[0102] The VDP 130 is connected to the VRAM 131 , 
and image data output from the VDP 1 30 is output to an 15 
encoder 160 through memory 132. The encoder 160 
generates image signals by adding synchronizing sig- 
nals or the like to the image data, and outputs them to 
the TV receiver 80. The game screen is thus displayed 
on the TV receiver 80. 20 
[01 03] The sound block 53 Is composed of a DSP 1 40 
for synthesizing souncte according to either PCM mode 
or FM mode, and a CPU 141 for controlling the DSP 
1 40. The audio data synthesized by the DSP 1 40 is con- 
verted to 2 channel signals by a D/A convertor 1 70, and 
is then output to speakers 80b. 
[0104] The subsystem 54 is composed of a CD-ROM 
driver 50b. CD i/F 180. CPU 181. MPEG Audio 182. 
MPEG Video 183, and the like. The subsystem 54 has 
the function of reading application software provided in 
the form of CD-ROM. and of reproducing animation. 
The CD-ROM drive 50b reads data from the CD-ROM. 
The CPU 1 81 executes processes such as control of the 
CD-ROM drive 50b and correcting errors in the data that 
Is read. The data read from the CD-ROM is fed through 
the CD I/F 180. bus 106. and SCU 100 to the CPU 101. 
where it is used as application software. The MPEG 
Audio 182 and MPEG Video 183 are devices for restor- 
ing data which has been compressed according to 
MPEG standards (motion picture expert group). Anima- 
tion can be reproduced by using the MPEG audio 182 
and MPEG video 183 to restore the MPEG compressed 
data written to CD-ROM. 

[0105] Fig. 25 illustrates a case of a soccer game 
being played, as an example of a game, in 3D virtual 
game space formed by a computer system. 
[0106] In the figure, a soccer court is formed on the x- 
z plane in 3D virtual space. The lengthwise direction 
(left-right direction) of the court is in the direction of the 
x axis, the breadthwise direction (depthwise direction) 
of the court is in the direction of the y axis, and the 
heightwise direction is in the direction of the z axis. Var- 
ious athlete objects not shown in the figure are situated 
on the court, and the game device players control the 
movements of the character athletes by means of irput 
devices. Line objects are described on the ground to 
form the soccer court. The game is relayed by a virtual 
camera (point of view) which is situated to display cir- 



cumstances in the visual field in virtual game space by 
means of coordinate conversion or the like on a two- 
dimensional monitor screen. 

[0107] Figs. 26 and 27 illustrate perspectives in the 
present invention. In Fig. 26, line objects are arranged 
by a combination of polygons (hereinafter referred to as 
line polygons} forming lines on the ground, and a soccer 
court drawn by the lines is formed, as shown in Fig. 25. 
The lines are well displayed on the screen when the 
camera position in game space is at an angle overlook- 
ing the field from above, but the surface area of the lines 
in the screen diminishes as the vertical (y axis) angle of 
the camera approaches the horizontal direction, arxl the 
lines gradually disappear from the monitor screen. Addi- 
tionally, in cases where the line polygons and camera 
face each other, that is, when the line polygon normal 
line vector and the camera's eye direction vector are 
parallel, it is sometimes possible for the line polygons to 
become so fine that they cannot be displayed on two- 
dimensional projection screens in which three-dimen- 
sional virtual space has undergone coordinate conver- 
sion when the point of view is sufficiently remote. This is 
disadvantageous in games which are played inside 
such lines (or a court). 

[0108] Thus, in the present invention, the positional 
coordinates of some of the vertices of line polygons are 
modified to increase the surface area projected by the 
camera under conditions which make it difficult for lines 
to be projected on the monitor screen. That is. 
[01 09] That is, in the reciprocal relation with the cam- 
era, the surface area of line polygons projected by the 
camera is increased by slightly elevating, as shown in 
Fig. 27, the height position of vertices located in the 
depthwise direction, as viewed from the camera, of the 
line polygons situated on the ground. 
[01 10] Fig. 28 is a flow chart illustrating the algorithm 
for such a process. 

[0111] First, when line polygons (or line objects) are 
present in the visual field of the camera viewing objects 
situated in virtual game space, a corresponding flag is 
established by the program not shown in the figure. 
^Nhen this is determined in the main program (not 
shown in figure), a process for preventing the lines from 
disappearing is executed (8102, YES). 
[01 12] It is first determined whether the vertices of the 
line polygons are located away from or toward the cam- 
era. A method for this, as shown in Fig. 29, is to calcu- 
late the distance 1 1 between the camera and vertex PI 
and distance 12 between the camera and vertex P3, 
and to determine the further and nearer vertices based 
on the magnitude of the two distances. 
[0113] Another method, as shown in Fig. 30. is to 
compare the angles 01 and 03 of the vertices PI and P3 
and the angles 01 and 03 of the camera to determine 
the further and nearer vertices PI and P3. Although 
either of these two methods can be used in the present 
embodiment, the latter is more advantageous because 
there are fewer calculations for the hardware than in the 
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former method. 

[01 1 4] The latter method for comparing angles is used 
to describe the determination of the further and nearer 
vertices of the line polygons in steps S104 through 
Si 10 below. 

[0115] The data of a line polygon Is read from an 
object table not shown in the figure which gives the 
object groups situated in the scene (S104). Fig. 31 is of 
an example of line polygon data, where, for example, 
coordinate values (Xp, Zn) of a world coordinate system 
as well as predetermined angles and the like for deter- 
mining further and nearer vertices are correlated in the 
data for polygon vertices PI through P4. 
[01 1 6] As shown in Fig. 30, the current position of the 
camera in the world coordinate system (x - z plane) and 
the angle 0n in the vertex Pn direction of a line polygon 
seen from the camera position are then read. The angle 
0n can be determined by a trigonometric function from 
the coordinates of the line polygon vertex Pn and the 
coordinates of the camera position (S106). 
[01 1 7] The line polygon vertex and camera angle are 
then compared (S108). In Fig. 30, for example, the pre- 
determined angle for vertex PI is 90 degrees, and the 
predetermined angle for vertex P3 is 270 degrees. 
When the angle 01 from the x axis of the eye direction 
vector between the camera and vertex PI is 120 
degrees, then 120 degrees - 90 degrees = 30 degrees < 
90 degrees (where 90 degrees is the reference value for 
determination in this case) (SI 08), allowing it to be 
determined as the vertex on the depthwise edge of the 
polygon (8110). 

[0118] When the angle 03 from the x axis of the eye 
direction vector between the camera and vertex P3 is 
150 degrees, then 150 degrees - 270 degrees = ABS 
(120 degrees) > 90 degrees (where 90 degrees is the 
reference value for determination in this case, and ABS 
is the absolute value) (SI 08). allowing it to be deter- 
mined as the vertex on the nearer edge of the line 
(S1 10). 

[01 1 9] When the vertex Pn is the nearer edge of a line 
object, no height adjustment is carried out for vertex Pn, 
and the data for the next line polygon vertex is read 
(S1 10. NO). 

[01 20] When the vertex Pn is the nearer edge of a line 
object (S1 10. YES), it is determined whether or not the 
distance to vertex Pn is 10 m or less. If 10 m or less 
(S1 12, YES), that is. when the camera is near the line, 
the line is normally visible on the screen, so the height 
of the vertex Pn is not adjusted, and the data for the next 
line polygon vertex is read (S1 12, NO). 
[0121] When the distance to the vertex Pn is more 
than 10 m (S112. NO), that is. when the camera is 
remote from the line, the line is usually difficult to seer 
so the value in the y axis direction (helghtwvise direction) 
in the coordinate data for the vertex Pn on the further 
edge of the line is increased a certain amount to raise 
the further edge of the line polygon up from the ground 
(S1 14). This process is carried out foe each of the verti- 



ces of all the line polygons in the screen (S1 16). 
[01 22] As a result, the further edges of the line objects 
situated in virtual game space are raised up. as shown 
in Fig. 27, allowing them to be easily seen from the cam- 
5 era. 

[01 23] A third embodiment of the present invention is 
described below. The third invention involves dividing 
the game field (soccer ground) into prescribed areas, 
determining the area in which the ball is located, and 
10 adjusting the camera angle so that the direction in which 
the ball is advancing (direction in which the player wants 
to look) can be readily seen. 

[0124] Figs. 32 through 34 illustrate the directions in 
which game device players move and desirable camera 
15 directions when moving in such directions. 

[01 25] First, as shown in Fig. 25. the camera basically 
moves along the sidelines and is directed in the player 
direction. Of course, the camera can move into the field 
to following the game. 
20 [0126] When players controlled by the game device 
players move in the direction to and away from the 
viewer (z axis direction) in the x -y plane (Fig. 32a). the 
camera is directed in the z axis direction (Fig. 32b). 
[0127] When the players controlled by the game 
25 device players move in the left direction (-x axis direc- 
tion) in the X - y plane (Fig. 33a), the camera is turned 
from the z axis direction to a specific angle, such as -15 
degrees, to increase the screen display in the area in 
the direction in which the ball is advancing (Fig. 33b). 
30 Here, the angle measured in the clockwise direction 
(positive direction) from the z axis is a positive value, 
and angles measured in the counterclockwise direction 
(negative direction) are negative values. 
[0128] When players controlled by the game device 
35 players move in the right direction (x axis direction) in 
the X - y plane (Fig. 34a). the camera is turned from the 
z axis direction to a specific angle, such as 15 degrees, 
to increase the screen display in the area in the direc- 
tion in which the ball is advancing (Fig. 34b). 
40 [0129] An example in which the direction of the cam- 
era point of view is determined by combining the cam- 
era angle adjustment and the game field area is 
described with reference to Figs. 35 and 36, 
[0130] The main routine for lateral camera angle 
45 adjustment is first executed according to prescribed tim- 
ing (conditions) determined in the main program not 
shown in the figure, and it is determined whether the 
main point of view of the camera is on the player side or 
the ball side (SI 32). 
so [0131] When it ts on the player side (8132, player 
side), it is determined whether or not the main point of 
view is a prescribed distance, such as 8 m or less, from 
the soccer court penalty area (SI 34). When within 8 m 
(SI 34. YES), opponents and fellow team mates gather 
55 in the vicinity of the penalty area, with a greater oppor- 
tunity to pass or shoot (Fig. 37). so the camera tilts 
about -15 degrees relative to the z axis to afford a better 
view of the vidntty of the penalty area (8136, Fig. 38). 
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[0132] When more than 8 m from the penalty area 
(SI 34. NO), the direction in which the player advances 
isdetermined (S138), When the player is moving tcward 
the viewer (Fig. 39) or away from the viewer (Rg. 40), 
the angle of the camera in the x - z plane is 0 degrees 
relative to the player (Si 40. Fig. 41). When the player is 
moving to the left (Fig. 42). the angle of the camera rel- 
ative to the player is -15 degrees from the z axis (S142. 
Fig. 43). When the player is moving to the right (Fig. 44), 
the angle of the camera relative to the player Is 15 
degrees from the z axis (SI 44, Fig. 45). 
[0133] When the ball is the main point of view of the 
camera (S132. ball side), it is determined whether or not 
the distance between the ball and player is a prescribed 
distance, such as 15 m or more (SI 46). If 15 m or more 
(S146, YES. Fig. 46). the camera angle is determined 
so that the eye direction vector from the ball toward the 
player is at an angle of 20 degrees from the z axis 
(Si 54, Fig. 47). When the position between the player 
and ball is the opposite, relative to the z axis, the cam- 
era angle is determined so that the eye direction vector 
from the ball to the player is -20 degrees (Si 54. Fig. 48). 
[01 34] When the distance between the t>all and player 
is not a specific distance such as 15 m or more (S146, 
NO), it is determined whether or not the main point of 
view of the camera is within 8 m of a penalty area 
(SI 48). When the main point of view of the camera is 
within 8 m of the penalty area (Si 48. YES, Fig. 49). the 
eye direction vector of the camera is set to an angle of - 
15 degrees (Fig. 50). When the position between the 
ball an player is the opposite, as shown in Fig. 48, the 
direction of the camera is set 15 degrees firom the z 
axis. 

[0135] When the distance between the ball and player 
is within 15 m, and the main point of view of the camera 
is not with 8 m of the penalty area (SI 48, NO, Fig. 51), 
the eye direction vector of the camera is set to 0 
degrees relative to the ball (0 degrees relative to the z 
axis) (Fig. 52). When these processes are concluded, 
the system returns to the main program. 
[01 36] Occasionally, it becomes difficult to play at right 
angles to the direction in which the player on the screen 
is moving In cases where player movement in the x and 
z directions is input by the game device player using an 
input device such as a pad or joystick if the camera 
angle from the z axis is too great when the camera 
moves along the sidelines. A camera angle of about 15 
degrees is thus advantageous. 

[0137] The camera angle of the player in the x - z 
plane is thus adjusted according to areas in the game 
field, affording a better view in the direction in which the 
ball is advancing. 

[0138] Vertical (y axis direction) camera angle adjust- 
ment is descrOsed below. Fig. 53 is a flow chart of the 
process for adjusting the vertical camera angle, which is 
executed according to prescribed timing (conditions) 
determined in the main program not shown in the figure. 
The camera height position is usually set, but not lim- 



ited, to a height of about 10 m. The main routine, as 
shown in Fig. 54. establishes the angle at which the 
camera tracks the game field according to game areeis. 
That is. the position of the main point of view of the cam- 

5 era is determined (Si 62). When the player is the main 
point of view (S162, player), it is determined whether or 
not the nriain point of view is near the penalty area 
(Si 64). When the main point of view is not near the pen- 
alty area (S164, NO), the camera direction is deter- 
to mined so that the eye direction vector of the camera is - 
8 degrees from the z axis, to afford a relatively broad 
range of vision (S166). Here, when the camera looks 
down, the angle is negative, when it looks up. the angle 
is positive, and when it is level, the angle is 0. When the 

75 main point of view is near a penalty area (SI 64. YES), 
the camera direction is determined so that the eye 
direction vector of the camera is -1 1 degrees from the z 
axis (SI 68). This allows the camera to give a better view 
overlooking the field, resulting in images with a better 

20 sense of depth and dimension. 

[0139] When the ball is the main point of view (SI 62. 
ball), it is determined whether or not the main point of 
view is near a penalty area (Si 70). When the main point 
of view is not near the penalty area (SI 70, NO), the 

25 camera direction is determined so that the line of sigh 
vector of the camera is -1 1 degrees from the z axis 
(S166). When the main point of view is near the penalty 
area (SI 70. YES), the camera direction is set so that 
the eye direction vector of the camera is -13 degrees 

30 from the z axis (SI 74). 

[0140] Upon the conclusion of these processes, the 
system returns to the main program. 
[0141] Fig. 55 is a flow chart of the camera zoom 
adjustment. When it is determined in the main program 

35 that camera zoom adjustment is needed, the process 
moves to the main routine. 

[0142] First, it is determined whether or not the main 
point of view of the camera is near a penalty area 
(SI 82). When it is near a penalty area, the camera 
40 zooms down to a prescribed distance from the main 
point of view (Si 84). This allows the entire penalty area 
to be seen. 

[0143] When the main point of view of the camera is 
not near the penalty area (SI 82. NO) and the player is 

45 outside the screen (SI 86. YES), the camera zooms 
down to project the player in the screen (8188). As 
shown in Fig. 56. when the player is in the screen 
(Si 86, NO) and the player is in 3/4 of the screen (SI 90, 
YES), the camera zooms up to a presaibed distance 

so from the main point of view (S190). This allows close 
ups of players in situations where a fixed range is not 
visible. When the player is projected on the screen but is 
in 3/4 of the screen (SI 90. NO), the distance between 
the camera dn main point of view is maintained (SI 94). 

55 [0144] Fig. 57 is a flow chart of another example ena- 
bling the display of objects which should be prevented 
from disappearing on the screen, such as the aforemen- 
tioned line polygons. 
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[0145] In the figure, attribute data indicating that an 
object is to be prevented from disappearing is added to 
the data of polygons which should be prevented from 
disappearing. When object groups in the visual field of 
the virtual camera are displayed on the screen, the 5 
computer system determines whether or not there are 
polygons which are to be prevented from disappearing 
in the visual field (S202). 

[0146] \Nhen there are polygons which should be pre- 
vented from disappearing, such as line polygons (S202, 10 
YES), a program that prevents polygons from disap- 
pearing is actuated. That is, as shown in Fig. 58. a unit 
eye direction vector is determined from the main point of 
view of the camera and the position of the camera 
(S204). The unit normal line vector is determined from is 
the data for polygons which are to be prevented from 
disappearing (S206). The angle between the unit eye 
direction vector and the unit normal line vector is deter- 
mined. This can be determined as the inner product of 
the unit eye direction vector and the unit normal line so 
vector (S208). The polygon vertex coordinate values 
are adjusted so that the angle is at a prescribed angle 
(S210). The process from step 204 to step 210 is exe- 
cuted for each polygon that is to be prevented from dis- 
appearing in the visual field. Here, step 202 2S 
corresponds to means for preventing such disappear- 
ance, steps 204 through 208 correspond to angle com- 
puting means, and step 310 corresponds to polygon 
tilting means. 

[0147] This allows lines and the like that are indispen- 30 
sable for a game to be prevented from disappearing. 
[0146] The present invention is not limited to soccer 
games, and is applicable for a variety of games in which 
a ground or court is described by lines, such as tennis, 
baseball, basket ball, volley ball, Rubgy, and American 35 
football. 

[0149] Camera zooming is thus adjusted according to 
area and display status. 

[0150] A program for executing the aforementioned 
Image processing device and for executing the method 40 
for displaying images on a computer system may be 
provided as a recording on data recording media such 
as CD-ROMs, DVD-ROMs, and ROM cassettes. 
[0151] The embodiment described with reference to 
Figs. 8 through 17 is not limited to embodiments in 45 
which the surfaces of polygons A through D" are 
mapped with textures of spectators facing the playing 
field, that is, examples of display objects displayed in 
three-dimensional virtual space serving as the game 
space. For example, among the textures mapped to pol- so 
ygon surfaces, portions of the background other than 
display objects modeled on spectators may be used as 
transparent bit textures, and portions of the display 
objects may be used as opaque bit textures. 
[0152] Fig. 59 is a schematic of such textures. The s& 
opaque bit texture area includes the spectator display 
objects 300 and sunrounding portions 301 as needed. 
Fig. 60 is an example of texture related to another spec- 



tator embodiment. The background 302 is similarly 
transparent bits, and the characters 304 are opaque 
bits. This texture is mapped to polygons other than pol- 
ygons mapped with the texture in Fig. 59, and polygons 
mapped with the texture in Fig. 60 are arranged in front 
of the polygons mapped with the texture in Fig. 59, that 
is, more on the virtual point of view side. Fig. 61 shows 
a state in which these textures are layered, that is. 
superposed, as shown In Figs. 8 through 17. The char- 
acters 304 in Fig, 60 are superposed on the transparent 
back ground portion of Fig. 59. Accordingly, when the 
polygons in Figs. 59 and 60 are superposed, spectators 
with the two textures are displayed on the screen while 
blended, grouped, and superposed. When spectators 
which are these polygon characters are superposed, 
the spectators toward the bottom in three-dimensional 
space, that is, spectators of polygons having the lowest 
priority, are under polygons having the highest priority, 
and are not displayed on the screen. 
[0153] Spectator movements can be reproduced or 
simulated in the same manner as the previous embodi- 
ment of spectator behavior by moving a plurality of pol- 
ygons mapped with such textures along planes 
perpendicular or otherwise intersecting the direction in 
which the plurality of polygons are superposed, or in a 
direction intersecting the virtual camera facing polygons 
A through D" in three-dimensional space, or in a direc- 
tion intersecting the direction in which they are super- 
posed, as shown in Figs. 8 through 17. 
[0154] Figs. 62 and 63 are of a case in which the pol- 
ygons 400 described in Fig. 59 the polygons 402 
described in Fig. 60 are superposed, where Fig. 62 
shows the polygons 400 moving up and Fig. 63 shows 
the polygons 402 moving up. 

[0155] Thus, in the present invention, movements 
such as that of several display objects moving as in the 
case of spectators around a soccer game field, move- 
ments of groups consisting of several display objects, 
and movements in cases where several display objects 
are preferably divided into several blocks and are 
moved while the blocks are controlled (movements of 
animals and insects) can be created more efficiently. 
Such movements are produced in specific modes, such 
as in the case of soccer games and when athletes com- 
peting over a ball make a goal. It bears repeating that 
the textures described here may be picture data includ- 
ing characters such as spectators and background 
(clouds, waves, etc.). In addition, instead of constructing 
the background portions in Fig. 59 with transparent tex- 
tures, texture of a single may be used, and the texture in 
Fig. 60 may be constructed of texture writh another color 
distinguishable from this single color. Furthermore, the 
background portion of Fig. 60 may be made of a single 
color texture, and the background portion of Fig. 59 can 
be used as it is with transparent colors, while at least the 
profiles of the characters in Fig. 59 are not the afore- 
mentioned single color. In the case of Figs. 8 through 
1 7. the polygons were arranged in. but are not limited to, 
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positions so as to be gradually inclining upward in virtual 
space, so the polygons can also be arranges in a virtu- 
ally level plane. 

[0156] In the aforementioned ennbodiments, the eyes 
of a character were directed at a target when it was s 
determined whether or not the relation to the game con- 
tents or the positional relation such as the distance 
between characters and the target having a relation 
through the game to the aforementioned characters 
matched certain conditions, so that when a character io 
competed white dribbling a ball in a soccer game, for 
example, the character looked in (surveyed) other direc- 
tions to look for team mates or kicking zones, allowing 
the behavior of actual soccer contestants to be more 
realistically simulated, providing more natural move- is 
ments, and achieving greater realism and immediacy. 
[01 57] The control of the point of view provides effects 
such as 1 ) affecting the strategies used in the game and 
the level o1 game difficulty, and 2) making it easier to 
understand and play situations or points to which the 20 
ball can (should) be passed based on the behavior of 
characters in the possession of the ball in ball games. 
[0158] In the embodiments, a plurality of polygons 
mapped with texture modeled on a plurality of specta- 
tors are virtually superposed, and the plurality of poly- 25 
gons are moved in a direction intersecting the direction 
in which they are superposed, so that the variegated 
movements (more realistic behavior) of individual spec- 
tators can be represented. Software design is simpli- 
fied, the computing load is reduced, and memory 30 
capacity can be reduced. These and other demands 
can be simultaneously addressed, and game immedi- 
acy can be further enhanced. 

[0159] Also in the embodiments, the time of the game 
being played by a game device player Is sensed, and 3S 
the screen colors for the innages are determined accord- 
ing to that time by corrections based on screen colors 
previously optimized for games, so that presentations 
with changes in the screen colors are added according 
to the time in which the game is being played, allowing 40 
the screen colors to be constantly maintained in such a 
way as to avokJ Interfering with the game. It is also pos- 
sible to avoid the drawbacks that occur when the screen 
color state is adjusted using only the luminance, as in 
the past, and it is furthermore possible to more consist- 45 
entty and accurately make the changes in brightness 
throughout the day compatible with the color state of the 
display screen, further enhancing game immediacy. 
[0160] Polygons which are difficult to see in virtual 
space due to the camera position sometimes occur in so 
games which develop in three-dimensional virtual 
space, so in anotiier emtxxliment. line objects drawn on 
the ground, for example, are prevented from disappear- 
ing by means of image processing. 
[0161] Yet another embodiment affords a game device ss 
for adjusting the camera position, camera direction, 
range of visual field, and the like according to the direc- 
tion in which the objects move or game areas, resulting 



in a screen that makes games easier to play. 
INDUSTRIAL APPLICABILITY 

[0162] As described above, the image processing 
device of the present invention allows simulations (such 
as games) in virtual space to be displayed more visibly 
and with more immediacy for observers (such as indi- 
viduals playing the game device) The invention is partic- 
ularly suitable for video (or television) game devices. 

Clainos 

1. An image processing device that displays the 
behavior of characters modeled on opponents in 
virtual three-dimensional space, wherein said 
Image processing device is characterized by com- 
prising: 

determination means for determining whether 
or not there exists a certain situation in which 
the relation to the game contents or the posi- 
tional relation between characters and a target 
having a relation through the game to said 
characters matches certain conditions; and 
eye direction control means for directing the 
eyes of said characters to said objects when 
the determination means has determined said 
certain situation exists. 

2. The image processing device according to Claim 1 , 
wherein sakl game is a soccer game, and said 
object is a ball in said soccer game. 

3. The image processing device according to Claim 1 , 
wherein said eye direction control means includes 
means for rotating and controlling the torsos and 
waists of said characters with the rotation of the 
heads of said characters. 

4. The image processing device according to Claim 1 , 
wherein said determination means includes means 
for computing the angle from said characters to the 
target based on coordinate values of said charac- 
ters and said target in said virtual three-dimen- 
sional space. 

5. The image processing device according to Claim 1 , 
wherein there are a plurality of said objects, and 
said determination means includes determination 
means for determining to which of said plurality of 
targets the eye direction should be directed accord- 
ing to said game situation. 

6. An image processing method for displaying the 
behavior of characters modeled on opponents in 
virtual three-dimensional space, wherein said 
image processing method is characterized in that a 
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determination is made as to whether or not there 
exists a certain situation in which the relation to the 
game contents or the positional relation between 
characters and a target having a relation through 
the game to said characters matches certain condi- 5 
tions, and the eyes of said characters are directed 
to said target when it has been determined that the 
certain situation exists. 

7. An image processing method for displaying the 10 
behavior of characters modeled on opponents in 
virtual three-dimensional space, wherein said 
image processing method is characterized in that a 
determination is made as to whether or not certain 
conditions have been established while said char- is 
acter is made to execute a first behavior, and said 
character is made to execute a second behavior 
when said certain conditions have been estab- 
lished, so that data of the developing game situa- 
tion is suggested to the player. 20 

8. An image processing device for displaying the 
behavior of display objects in virtual three-dimen- 
sional space, wherein said image processing 
device is characterized by comprising: 2S 

a plurality of polygons in which textures are 
individually mapped to a plurality of display 
objects, said plurality of polygons being virtu- 
ally superposed; 

and polygon oscillation means for moving the 
plurality of polygons along planes intersecting 
the directions in which the polygons are super- 
posed. 

35 

9. The image processing device according to Claim 8, 
wherein said plurality of polygons are virtually 
superposed, while the plurality of polygons that 
form the various plurality of objects are interleaved 
according to the sequence of objects, and said pol- 40 
ygon oscillation means is a means for periodically 
moving said plurality of objects while synchronized 
and linked with each object. 

10. The image processing method according to Claim 45 
9. wherein said moving direction is the vertical or 
lateral direction of said polygons. 

11. An image processing method for displaying the 
behavior of display ot^jects in virtual three-dimen- so 
sional space, wherein said image processing 
method is characterized in that a plurality of poly- 
gons individually mapped with textures modeled on 

a plurality of display objects are virtually super- 
posed, and said plurality of polygons are moved in ss 
directions intersecting the directions in which the 
polygons are superposed. 



12. An image processing device for simulating and dis- 
playing games in virtual three-dimensional space, 
wherein said image processing device is character- 
ized by comprising: 

sensing means for sensing the time of said 
game being played by a player; and 
adjusting means for adjusting the screen colors 
of said images according to the time sensed by 
the sensing means. 

13. The image processing device according to Claim 
12, wherein said adjusting means comprises mem- 
ory means by which values for screen colors of at 
least two standard time zones established for situa- 
tions suited to the game are stored in the form of 
various reference values; and data generating 
means which, when the time sensed by said sens- 
ing means is within either of said standard time 
zones, generates masking data for the game dis- 
play screen based on the corresponding one of said 
reference values, and which, when said time is not 
within either of said standard time zones, generates 
said masking data based on information for the 
screen color state interpolated on the basis of the 
two reference values temporally prior to and follow- 
ing said time in said at least two reference values. 

14. An image processing method for simulating and 
displaying games in virtual three-dimensional 
space, wherein said image processing method is 
characterized by sensing the time of said game 
being played by the player, and by adjusting the 
screen color of said images according to said time. 

15. An image processing method in which a display 
object modeled on a living creature in virtual three- 
dimensional space is displayed on a display screen, 
as the perspective is changed from a given point of 
view, wherein said image processing method is 
characterized by the steps of: 

comparing the position of an imaginary point 
determined in said virtual space and the posi- 
tion of said display object; 
determining whether or not the results of said 
comparison match certain conditions set by a 
program; and 

establishing said imaginary point as the main 
point of view of said display object when the 
results of said match said certain conditions. 

16. An image processing method in which a display 
object modeled on a living creature in virtual three- 
dimensional space is displayed on a display screen, 
as the perspective is changed from a given point of 
view, wherein said image processing method is 
characterized by the steps Of: 
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comparing the position of a plurality of imagi- 
nary points determined in said virtual space 
and the position of said display object; and 
selecting said imaginary point as the main 
point of view of said display object. s 

17. An image processing device for situating objects in 
virtual space formed by a computer system, devel- 
oping a game while controlling the movements of 
said objects according to input control and set io 
rules, and displaying circumstances in said virtual 
space as the screen seen from a virtual camera, 
wherein said image processing device is character- 
ized by comprising: 

15 

polygons situated on a reference plane serving 
as the reference in said virtual space; 
determination means for determining the posi- 
tional relation between said polygons and said 
virtual camera; and 20 
polygon tilting means for tilting said polygons, 
according to the results of the determination, 
so as to increase the surface area of said poly- 
gons seen from said virtual camera. 

25 

18. The image processing device according to Claim 
17. wherein said reference plane is the ground, and 
said polygons are polygons forming lines situated 
on said ground. 

30 

19. The image processing device according to Claim 
17, wherein said polygons are quadrilateral, and 
said polygon tilting means modifies the coordinate 
values of the vertices on one of the sides of mutu- 
ally facing sides of said polygons. 35 

20. An image processing device for situating objects in 
virtual space formed by a computer system, devel- 
oping a game while controlling the movements of 
said objects according to input control and set 40 
rules, and displaying circumstances in said virtual 
space as the screen seen from a virtual camera, 
wherein said image processing device is character- 
ized by comprising: 

45 

determination means for determining whether 
or not said objects are in a specific area in said 
virtual space; and 

camera angle adjusting means for adjusting 
the angle of said virtual camera based on the so 
results of said determination. 

21. The image processing device according to Claim 
20. wherein said camera angle adjusting means 
adjusts the angle of said virtual camera based on 55 
the results of said determination and the direction in 
which said objects are moving. 



22. The image processing device according to Claim 
20 or 21, wherein said camera angle adjusting 
means adjusts the angle of said virtual camera in at 
least one of either the lateral and vertical directions 
in said virtual space. 

23. An image processing device for situating objects in 
virtual space formed by a computer system, devel- 
oping a game while controlling the movements of 
said objects according to input control and set 
rules, and displaying circumstances in said virtual 
space as the screen seen from a virtual camera, 
wherein said image processing device is character- 
ized by comprising: 

determination means for determining whether 
or not said objects are in a specific area in said 
virtual space; and 

zoom adjusting means for adjusting the range 
of the field of vision of said virtual camera 
based on the results of said determination. 

24. An image processing device having an image gen- 
erating display means for converting virtual space 
constructed with a three-dimensional model con- 
sisting of a plurality of polygons to two-dimensional 
images seen from a virtual camera in any position, 
and displaying them on a display device, wherein 
said image processing device comprises: 

angle computing means for conrputing the 
angle between an eye direction vector showing 
the direction in which said virtual camera is fac- 
ing and a normal line vector showing the orien- 
tation of the plane of certain polygons situated 
in said virtual space; and 
polygon tilting means for changing the coordi- 
nate values of the vertices of said polygons, so 
that the angle computed by said angle comput- 
ing means assumes a certain value. 

25. An image processing device having image generat- 
ing display means for generating two-dimensional 
images that reveal, from any point of view, virtual 
space constructed with a three-dimensional model 
consisting of a plurality of polygons, and for display- 
ing them on a display device, said polygons com- 
prising nondisappearing polygons which have 
attributes preventing them from disappearing and 
which contain data for operating a program to pre- 
vent polygons from disappearing; 

said disappearance prevention program com- 
prising position determination means for deter- 
mining the positional relation between said 
nondisappearing polygons and said point of 
view, and coordinate modification means for 
modifying the coordinate values of the vertices 
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of said nondisappearing polygons according to 
the results of the determination by said position 
determination means; and 
said image processing device furthermore 
comprising disappearance prevention execu- s 
tion means for executing said disappearance 
prevention program when the polygons visual- 
ized on said display device are said nondisap- 
pearing polygons. 

10 

26. Data recording media oh which has been recorded 
a program for allowing a computer system to func- 
tion as an image processing device according to 
any of Claims 1 through 5, 8, 9. 12, 13. and 17 
through 25. 

27. An image processing device for displaying circum- 
stances in virtual three-dimensional space in the 
form of images seen from a camera, wherein said 
image processing device comprises: so 

polygons situated on a reference plane serving 
as reference in said virtual three-dimensional 

space; 

determination means for determining the posi- 25 
tional relation between said polygons and said 
virtual camera; and 

polygon tilting means for tilting said polygons, 
according to the results of the determination by 
said determination means, so as to increase so 
the surface area of said polygons seen from 
the virtual camera. 

28. An image processing device for displaying circum- 
stances in virtual three-dimensional space in the 35 
form of images seen from a virtual camera, wherein 
said image processing device comprises: 

polygons situated on a reference plane serving 
as reference in said virtual three-dimensional 40 

space; 

determination means for determining the posi- 
tional relation between said polygons and said 
virtual camera; and 

polygon tilting means for tilting said polygons. 45 
according to the results of the determination by 
said determination means, so as to allow the 
vertices in the interior, relative to said virtual 
camera, of said polygons to stand out from said 
reference plane, while centered on the vertices so 
in the front, relative to said virtual camera, of 
said polygons. 



set rules. 

30. The game device according to Claim 29. character- 
ized in that said game is a game in which objects 
are situated in a game field formed on a reference 
plane, and said polygons are polygons forming 
lines described on said game field. 

31. An image processing device fa displaying circum- 
stances in said virtual three-dimensional space in 
the form of images seen from a virtual camera, 
wherein said image processing device comprises: 

polygons situated in said virtual three-dimen- 
sional space; 

determination means for determining the posi- 
tional relation between said polygons and said 

virtual camera; and 

polygon tilting means for tilting said polygons, 
according to the results determined by said 
determination means, so as to increase the 
surface area of said polygons seen from the 
virtual camera. 

32. The image processing device according to Claim 
27. 28. or 31. characterized in that said polygons 
are polygons that show lines. 

33. A game device, characterized by comprising an 
image processing device according to Claim 31 , for 
executing a game by situating objects in said virtual 
three-dimensional space and by controlling said 
objects according to player input control and set 
rules. 

34. The game device according to Claim 33. character- 
ized in that said game is a game in which objects 
are situated on a plane, and said polygons are pol- 
ygons forming lines described on said plane. 



29. A game machine, characterized by comprising an 
image processing device according to Claim 27 or ss 
28, for executing a game by situating objects in said 
virtual three-dimensional space and by controlling 
said objects according to player input control and 
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